Neural Architecture Search Survey: A Hardware Perspective

نویسندگان

چکیده

We review the problem of automating hardware-aware architectural design process Deep Neural Networks (DNNs). The field Convolutional Network (CNN) algorithm has led to advancements in many fields, such as computer vision, virtual reality, and autonomous driving. end-to-end a CNN is challenging time-consuming task, it requires expertise multiple areas signal image processing, neural networks, optimization. At same time, several hardware platforms, general- special-purpose, have equally contributed training deployment these complex networks different setting. Hardware-Aware Architecture Search (HW-NAS) automates DNNs alleviate human effort generate efficient models accomplishing acceptable accuracy-performance tradeoffs. goal this article provide insights understanding HW-NAS techniques for various platforms (MCU, CPU, GPU, ASIC, FPGA, ReRAM, DSP, VPU), followed by co-search methodologies accelerator specifications.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Neural Networks in Hardware: A Survey

Over the past decade a large variety of hardware has been designed to exploit the inherent parallelism of the artificial neural network models. This paper presents an overview of neural network hardware. Neural network basics, hardware specification and performance evaluation are introduced. Major categories of neural network architectures are reviewed. Two examples of neurohardware, CNAPS and ...

متن کامل

Progressive Neural Architecture Search

We propose a method for learning CNN structures that is more efficient than previous approaches: instead of using reinforcement learning (RL) or genetic algorithms (GA), we use a sequential model-based optimization (SMBO) strategy, in which we search for architectures in order of increasing complexity, while simultaneously learning a surrogate function to guide the search, similar to A* search....

متن کامل

Differentiable Neural Network Architecture Search

The successes of deep learning in recent years has been fueled by the development of innovative new neural network architectures. However, the design of a neural network architecture remains a difficult problem, requiring significant human expertise as well as computational resources. In this paper, we propose a method for transforming a discrete neural network architecture space into a continu...

متن کامل

A low-power hardware search architecture for speech recognition

High-performance speech recognition is extremely computationally expensive, limiting its use in the mobile domain. We therefore propose a low-power hardware speech recognition architecture for mobile applications, exploiting the orders-of-magnitude efficiency improvements dedicated hardware can offer. Our system is based on the Sphinx 3.0 software recognizer developed at Carnegie Mellon Univers...

متن کامل

Survey: Implementing Dense Neural Networks in Hardware

Neural networks are useful structures for enabling computers to learn and become better at complex activities such as pattern recognition and classification. When simulated in software, they are limited by the low levels of parallelism in today’s commodity processors. To run optimally, a hardware implementation is desirable. Unfortunately, most neural networks are extremely dense and contain ma...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: ACM Computing Surveys

سال: 2022

ISSN: ['0360-0300', '1557-7341']

DOI: https://doi.org/10.1145/3524500